FogAdapt: Self-supervised domain adaptation for semantic segmentation of foggy images
نویسندگان
چکیده
This paper presents FogAdapt, a novel approach for domain adaptation of semantic segmentation dense foggy scenes. Although significant research has been directed to reduce the shift in segmentation, scenes with adverse weather conditions remains an open question. Large variations visibility scene due conditions, such as fog, smog, and haze, exacerbate shift, thus making unsupervised scenarios challenging. We propose self-entropy multi-scale information augmented self-supervised method (FogAdapt) minimize segmentation. Supported by empirical evidence that increase fog density results high probabilities, we introduce based loss function guide method. Furthermore, inferences obtained at different image scales are combined weighted uncertainty generate scale-invariant pseudo-labels target domain. These robust scale variations. evaluate proposed model on real clear-weather synthetic non-foggy images scenarios. Our experiments demonstrate FogAdapt significantly outperforms current state-of-the-art images. Specifically, considering standard settings compared (SOTA) methods, gains 3.8% Foggy Zurich, 6.0% Driving-dense, 3.6% Driving mIoU when adapted from Cityscapes Zurich.
منابع مشابه
Semi-supervised Domain Adaptation for Weakly Labeled Semantic Video Object Segmentation
Abstract. Deep convolutional neural networks (CNNs) have been immensely successful in many high-level computer vision tasks given large labelled datasets. However, for video semantic object segmentation, a domain where labels are scarce, e↵ectively exploiting the representation power of CNN with limited training data remains a challenge. Simply borrowing the existing pre-trained CNN image recog...
متن کاملType-Supervised Domain Adaptation for Joint Segmentation and POS-Tagging
We report an empirical investigation on type-supervised domain adaptation for joint Chinese word segmentation and POS-tagging, making use of domainspecific tag dictionaries and only unlabeled target domain data to improve target-domain accuracies, given a set of annotated source domain sentences. Previous work on POS-tagging of other languages showed that type-supervision can be a competitive a...
متن کاملDiverse Sampling for Self-Supervised Learning of Semantic Segmentation
We propose an approach for learning category-level semantic segmentation purely from image-level classification tags indicating presence of categories. It exploits localization cues that emerge from training classification-tasked convolutional networks, to drive a “self-supervision” process that automatically labels a sparse, diverse training set of points likely to belong to classes of interes...
متن کاملWeakly-Supervised Segmentation of Non-Gaussian Images via Histogram Adaptation
Here we apply an active contour model that allows for arbitrary intensity distributions inside and outside the boundary of an object to be segmented in an image. Computationally, we estimate intensity histograms both inside and outside the current boundary estimate, and use these histograms to define an image energy as their log-likelihood ratio. Training the model with accurate example segment...
متن کاملMix-and-Match Tuning for Self-Supervised Semantic Segmentation
Deep convolutional networks for semantic image segmentation typically require large-scale labeled data, e.g., ImageNet and MS COCO, for network pre-training. To reduce annotation efforts, self-supervised semantic segmentation is recently proposed to pre-train a network without any humanprovided labels. The key of this new form of learning is to design a proxy task (e.g., image colorization), fr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2022
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2022.05.086